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APPARATUS AND METHOD FOR DEFINING RULES 
FOR PERSONAL AGENTS 



5 CROSS-REFERENCES TO RELATED APPLICATIONS 

This application claims the benefit of U.S. 
Provisional Application No. 60/015,070, filed April 9, 
1996, entitled "Apparatus and Methods for Defining 
10 Rules." 

RACK-GROUND OF THE INVENTION 

The invention relates to an agent manager for 
15 personal software agents. More particularly, the 

invention relates to a method and apparatus for defining 
rules for personal agents to acquire user-specific 
knowledge and accomplish user specified tasks. 

Personal software agents are computer programs that 
20 act on behalf of users to perform routine, tedious and 
time-consuming tasks. To be useful to an individual 
user, an agent must be personalized to the individual 
user's goals, habits and preferences. Thus, there 
exists a substantial need for the agent to efficiently 



2 

Murray 1-5 

and effectively acquire user- specif ic knowledge from the 
user, Previous attempts to solve this problem, however, 
prove to be unsatisfactory in many ways. 

The concept of agency, or the use of agents, is 
5 well established. An agent is a person authorized by 

another person, typically referred to as a principal, to 
act on behalf of the principal. In this manner, the 
principal empowers the agent to perform any of the tasks 
that the principal is unwilling or unable to perform. 
10 For example, an insurance agent may handle all insurance 
matters for a principal, a talent agent may act on 
behalf of a performer in arranging concert dates, and a 
foreign agent may spy on other governments to gather 
secret information on behalf of his or her government. 
15 With the advent of the computer, a new domain for 

employing agents has opened up. Significant advances in 
the realm of artificial intelligence have enabled 
computer programs to act on behalf of computer users to 
perform routine, tedious and other time-consuming tasks. 
2 0 These computer programs are referred to as "software 
agents . " 

Moreover, there has been a recent proliferation of 
computer and communications networks. These networks 
permit a user to access vast amounts of information and 
25 services without, essentially, any geographical 

boundaries . Thus a personal software agent has a rich 
environment to perform a large number of tasks on behalf 
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of a user. For example, it is now possible for a 
software agent to make an airline reservation, purchase 
the ticket, and have the ticket delivered directly to a 
user. Similarly, a software agent could scan the 
5 Internet and World Wide Web (WWW) to retrieve 

information ranging from the latest sports or news to a 
particular graduate thesis in molecular biology. A 
scenario could even be envisioned where a personal 
software agent automatically checks the weather every 

10 morning and changes a users wake-up alarm accordingly, 
e.g. . one-hour later in the case of a snow delay. 

To operate effectively, software agents require 
agent managers to acquire certain information. This 
information can be generally categorized as: (1) 

15 knowledge of the task domains within which the agent is 
to work; and (2) user-specific knowledge such as a 
user's preferences, habits and goals. 

Knowledge of the task domains within which an agent 
is to operate is usually supplied by the application 

2 0 developer. Examples of various task domains include 
electronic messaging, electronic banking or personal 
financial services . The fundamental ontology, or 
vocabulary, usually consists of objects and actions. In 
messaging, for example, objects includes messages, 

25 folders, persons and groups. Actions in messaging 

include moving a message to a folder, forwarding the 
message to another user, and replying to the sender. 
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Some objects and actions are very general and thus 
useful in many domains, e.g. . notification actions such 
as popping up a window on a computer screen, placing a 
call, and paging. 
5 The agent also requires knowledge about it's owners 

preferences, habits and goals, which is typically 
supplied by the user. Much of this type of knowledge 
can be expressed as If -Then rules. Examples of such 
rules might include: 

10 

1. (messaging) If I get a message from by boss 
with the subject "urgent" after business hours, then 
notify me by calling my home number. 

15 2. (banking) If the balance in my checking 

account falls below $500 and the balance in my 
savings account is above $2000, then transfer $500 
from savings to checking. 

20 3. (finances) If the price of XYZ stock falls 

below $3 0, buy 10 0 shares. 

The effective acquisition of user-specific 
knowledge has posed a serious problem in the area of 
25 personal software agents. Conventional methods for a 
software agent managers to acquire user-specific 
knowledge fall within three broad categories: (1) 
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learning; (2) programming by demonstration (PBD) , and 
(3) end-user programming (EUP) . Each of these 
categories of methods will be discussed in turn. 

The learning approach is detailed in a paper by P. 
5 Maes titled "Agents that Reduce Work and Information 

Overload/' CACM 37, 7 (July 1994), pp. 55-67. The agent 
learns rules by watching user behavior and detecting 
patterns and regularities. The agent records a user's 
activity in terms of situation-action pairs. For 

10 example, a situation could be an e-mail message and an 
action the way the user processed the message. The 
system predicts how a new situation should be handled by 
finding the most similar previously seen situation. 
After seeing enough examples, the system is able to make 

15 good predictions, and make suggestions to the user. The 
user may also instruct the agent to act on its own when 
the user's confidence in the agent's predictions exceeds 
a specified threshold. 

The problem with the learning method is that the 

20 agent manager has a slow learning curve. The agent 

manager is unable to offer any advice until it has seen 
a significant number of examples. Further, the agent 
manager cannot offer assistance in truly new situations 
since there were no previous examples from which to 

2 5 draw. This limitation can be minimized by permitting 
one software agent manager to access the experience of 
another software agent manager. This solution, however, 
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fails to personalize the agent in the preferences, 
habits and goals of the agent's owner. 

The PBD method is discussed in a book by A. Cypher 
titled "Watch What I Do: Programming by Demonstration/' 
5 MIT Press, Cambridge, MA, 1993. In PBD, a user puts a 
system into record mode to record a user's actions in an 
executable file. This technique is similar to the macro 
function on many popular word processors. The 
prototypical PBD systems operate in domains that have a 

10 natural graphical representation. One example is KIDSIM 
which is outlined in a paper by D.C. Smith et al . titled 
"KIDSIM: Programming Agents Without a Programming 
Language," CACM 37, 7 (July 1994), 55-67. In KIDSIM, 
children create simulations in which characters move 

15 around in a two-dimensional world. They create rules by 
using a graphical editor to depict changes of state -- 
that is, they draw the configuration of the world before 
and after the rule has applied. The system generalizes 
from the concrete objects in the demonstration to create 

20 an abstract rule, e.g. , replacing a particular character 
by any character of a certain type and replacing 
absolute locations by relative changes in location. 

The problem with the personal agents using the PBD 
method is that there is no mechanism by which the 

2 5 personal agent may determine if rules are incompatible 
with other rules. Moreover, if there are 
incompatibilities, the personal agent does not offer 
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solutions for repairing the invalid rule. 

The foundational research on end-user programming 
(EUP) is found in a work by T. W. Malone et al - titled 
"Experiments with Oval: A radically Tailorable Tool for 
5 Cooperative Work," ACM Transactions on Information 
Systems 13, 2 (April 1995), 177-205. A user first 
indicates the type of object to which the rule applies, 
such as a message . The user then describes the 
conditions of the rule by filling out a form that 

10 contains a field for each attribute of the object. For 
messages, the attributes would include sender, subject, 
recipient, and so forth. Finally, the user specifies 
the actions of the rule by selecting from a list of all 
the actions that could apply to this type of object. 

15 For example, a message could be moved, copied, 
forwarded, deleted, and so on. 

As with personal agents using the PBD method, 
traditional personal agents using the EUP method are 
incapable of determining whether rules are incompatible 

2 0 with other rules, and if so, offering repairs to the 
rule . 

A substantial need, therefore, exists for an agent 
manager which can acquire user- specif ic knowledge in the 
form of rules in a manner which is timely and precise, 
25 and which can detect and repair any conflicts with 
existing rules . 
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SUMMARY OF THE INVENTION 

In view of the foregoing, there exists a need in 
the art for a method and apparatus for solving the 
5 above-stated problems. More particularly, there is a 
need in the art for a method and apparatus for a 
personal software agent using enhanced EUP methods to 
acquire knowledge about a user's habits, preferences and 
goals using an agent manager. The agent manager allows 

10 the user to define new rules, and determines whether 
such rules conflict with existing rules. If such a 
conflict exists, the agent manager interactively guides 
the user in selecting and applying repairs for the new 
rules to remove the conflict. 

15 Thus, one embodiment of the invention permits a 

user and agent manager to collaborate in developing and 
managing a set of rules that embody the user's 
preferences for handling a wide variety of situations. 

This is accomplished using an apparatus and method 

20 for defining rules for a personal software agent. One 
embodiment of the invention includes an agent manager 
which uses a rule edit module for defining at least one 
condition and at least one action to form a new rule. 
The invention uses a rule index module for placing the 

25 new rule in a rule hierarchy, wherein the hierarchy is 
comprised of parent rules, child rules, and sibling 
rules. The rule index module adds actions from the 
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parent rules to the new rule and from the new rule to 
the child rules. The rule index module also creates 
intersection rules from an intersection of the new rule 
with the sibling rules. The invention uses a rule 
5 analysis module for determining whether the new rule and 
the intersection rules conflict wxth any existing rules 
in the hierarchy. The invention uses a rule repair 
module for repairing the new and intersection rules 
where such conflicts exist. 

10 With these and other advantages and features of the 

invention that will become hereinafter apparent, the 
nature of the invention may be more clearly understood 
by reference to the following detailed description of 
the invention, the appended claims and to the several 

15 drawings attached herein. 

RRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flow diagram illustrating the overall 
2 0 structure of one embodiment of the invention. 

FIG. 2 is a flow diagram of a decision-making 
portion of a rule edit module used in accordance with 
one embodiment of the invention. 

FIG. 3 is a picture of a rule editor used in 
2 5 accordance with one embodiment of the invention. 

FIG. 4 is a flow diagram of a new rule portion of a 
rule edit module used in accordance with one embodiment 
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of the invention . 

FIG. 5 is a flow diagram of an existing rule 
portion of a rule edit module used in accordance with 
one embodiment of the invention. 
5 FIG. 6 is a flow diagram of a rule index module 

used in accordance with one embodiment of the invention. 

FIG. 7 is a flow diagram of a rule analysis module 
used in accordance with one embodiment of the invention. 

FIG. 8 is a flow diagram of a first portion of a 
10 rule repair module used in accordance with one 
embodiment of the invention. 

FIG. 9 is a flow diagram of a second portion of a 
rule repair module used in accordance with one 
embodiment of the invention. 

15 

DETAILED DESCRIPTION 

Referring now in detail to the drawings wherein 
like parts are designated by like reference numerals 

2 0 throughout, there is illustrated in FIG. 1 a flow 
diagram illustrating the overall structure of one 
embodiment of the invention. FIG. 1 shows four modules: 
rule edit module 2 00; rule index module 3 00; rule 
analysis module 400; and rule repair module 500. 

2 5 The invention relates to an agent manager for 

personal software agents. More particularly, the 
invention relates to a method and apparatus for defining 
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rules for personal agents to acquire user-specific 
knowledge and accomplish user specified tasks. 

The invention comprises an agent manager which 
improves end-user programming by allowing the agent 
5 manager to perform the more complicated programming 
tasks for the user, thereby minimizing programming 
commands and syntax for the user. The agent manager 
allows the user to focus on three tasks: (1) define 
conditions; (2) define attributes; and (3) define 

10 actions. Once these three tasks are accomplished, a 

rule is formed. As a user creates or edits rules, the 
agent manager analyzes the rules for problems, computes 
methods of repairing the problems, and guides the user 
in selecting and applying the repairs. 

15 The agent manager's role is to watch for problems 

as users create or edit rules and help users to repair 
problems that it detects. Specifically, the agent 
manager detects when a rule's plan is not valid, i.e., 
some action does not apply or the rule conflicts with an 

20 existing rule. This can occur either as a user edits a 
rule or when a new rule is added to a rule hierarchy 
(due to interactions with other rules, described more 
fully below) . When the agent manager finds an invalid 
plan, it computes repairs, which are changes to the plan 

25 that will make the plan valid. It then presents an 

interactive explanation that explains the nature of the 
problem and guides the user in selecting a repair. One 
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embodiment of invention will be discussed in detail 
using electronic mail as an example. 

FIG. 2 is a flow diagram of a portion of a rule 
edit module used in accordance with an embodiment of the 
5 invention. The invention uses rule edit module 200 to 
specify rule conditions and actions. As shown in FIG. 
2, if a user wants to enter a new rule at step 202, the 
rule edit module performs the actions detailed in FIG. 
4. If a user wants to edit an existing rule at step 
10 202, the rule edit module performs the actions detailed 
in FIG . 5. 

FIG. 3 is a picture of a rule editor used in 
accordance with one embodiment of the invention. The 
following descriptions of FIG. 4 and FIG. 5 may be 

15 enhanced by referring to FIG. 3. 

FIG. 4 is a flow diagram of a new rule portion of a 
rule edit module used in accordance with one embodiment 
of the invention. At step 204, a user specifies rule 
conditions, examples of which include restricting the 

20 values of the message type, sender, recipient, subject, 
and the date and time of arrival. By specifying these 
rule conditions, the user defines the set of messages to 
which the rule applies. For example, FIG. 3 shows a 
rule that applies to e-mail messages from Julia 

25 Hirschberg whose subject field contains the word 

"important . " As the user specifies the conditions , the 
system continuously updates and displays the rule's 
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context, i.e. , its relationship to other rules and 
actions the rule will inherit from more general rules 
(as discussed in reference to FIG. 6) . 

The user can also specify using rule edit module 
5 200 two types of conditions about the arrival date and 
time of messages. First, users may specify messages 
that arrive in a particular interval, such as "between 
4:00 p.m. on September 15, 1995 and 8:00 a.m. on 
September 20, 1995." The user can also specify intervals 

10 such as "from November 1995 to March 1996," and "after 

5:00 p.m. on September 15, 1995." Second, the user can 
specify messages that arrive during a particular period, 
such as "during June, July and August," "on Saturday or 
Sunday," "between 1800 and 0800," "on the first Monday of 

15 each month," and "on the last working day of the month." 
As the user enters the conditions at step 204, 
these conditions define an initial state. The initial 
state is the class of messages to which the actions 
apply. For example, the initial state for the rule in 

20 FIG. 3 is 

InSpool and 

messageType = email and 
sender = Julia-Hirshberg and 
25 subject contains "important". 

This initial state will be transformed as new actions 
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add or delete facts from the initial state. 

At step 208 , a user selects rule actions. In our 
e-mail example, the set of actions could include Move 
Message, Forward Message, Notify by Paging, Notify with 
5 Pop Alert, and so forth. As shown in FIG. 3, the rule 
contains a single action that moves messages to a folder 
named "julia." The system has determined that one rule 
named "Email" is more general, and that one action "Copy 
Message "email archive, 1 " will be inherited to this rule 

10 (as discussed in reference to FIG. 6) . 

At step 210, the agent manager tests whether the 
selected action is permitted by the system in the state 
in which the specified conditions and previous actions 
have been applied. If it is, the agent manager updates 

15 the current state at step 220. If the action is not 
permitted, the user is informed and can then select 
another action, or change the rule conditions. 

FIG. 5 is a flow diagram of an existing rule 
portion of a rule edit module used in accordance with 

2 0 one embodiment of the invention. As shown in FIG. 2, if 
the user wants to edit an existing rule, the agent 
manager performs the actions detailed in FIG. 5. 

As shown in FIG. 5, the agent manager tests whether 
there is any change in rule conditions at step 222. If 

25 there is , the agent manager redefines the initial state 
at step 224 and must recheck the validity of the entire 
plan (as detailed in reference to FIG. 7) . The agent 



118692 



Murray 1-5 lb 

manager sets a condition flag at step 226 , and tests 
whether the user has changed any actions at step 228. 
If at step 222 no changes in the conditions have been 
detected, the agent manager moves directly to test 
5 whether the user has changed any actions at step 228. 

If the user has not changed any actions at step 228, the 
agent manager checks whether the condition flag has been 
set at step 24 8. If it has, the agent manager resets 
the condition flag at step 23 8 and moves to rule 

10 analysis module 400. If the condition flag has not been 
set, the program waits for user input, or the 
termination of the agent manager. 

If the user changes an action at step 228, the 
agent manager tests whether the user added an action at 

15 step 230. If the user has added an action to the end of 
plan, all that must be checked is that action 1 s 
applicability, i.e. , the action is possible for the 
selected condition. Thus, at step 232 the added action 
is tested as to whether it is valid. If it is not, the 

2 0 user is prompted or directed to select another action. 
Alternatively, the user could select a condition that 
conforms to the action initially selected. If the 
action is valid, the agent manager updates the current 
state of the plan at step 234 and checks to see if the 

2 5 user changed any conditions by checking whether the 

condition flag was set at step 236. If no conditions 
were changed, this program module ends, or 
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alternatively, allows the user to make additional edits 
to the existing or other rule plans. If the condition 
flag is set at step 236 , then the condition flag is 
reset at step 238 and the program module returns. 
5 If at step 23 0, the user did not add an action, the 

agent manager tests whether the user wants to delete or 
insert an action at steps 240 and 242, respectively. If 
either action is selected, the agent manager checks at 
step 244 whether the action is valid. If it is, the 

10 agent manager updates the current state of the plan at 
step 246, resets the condition flag at step 238, and 
returns. If the action is not valid at step 240 or 242, 
the program informs the user and prompts the user to 
perform another action. 

15 FIG. 6 is a flow diagram of a rule index module 

used in accordance with one embodiment of the invention. 
To better understand how the agent manager indexes 
rules, it may be helpful to first describe the 
representation and reasoning technology used by the 

2 0 invention. 

The rule representation used in the invention 
should enable three functions: 



1. Determine whether an action may apply in a 
25 given context, e.g. , to a specified set of 

messages , or after certain other actions ; 
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2. Determine when one rule subsumes another, that 
is determine whether the set of objects to which 
the first rule applies is a superset of the set of 
objects to which the second rule applies; 

5 

3. Determine when two rules intersect, that is 
determine whether the set of objects to which the 
first rule applies intersects the set of objects to 
which the second rule applies. 

10 

One example of representing rules in accordance 
with the invention is through the use of CLASSIC, which 
is detailed in a paper by A. Borgida et al . titled 
"CLASSIC: A Structural Data Model for Objects," SIGMOD 

15 28_9, (1989) , and a paper by R. J. Brachman titled "Living 
with Classic: When and How to Use a KL- ONE -Like 
Language," Formal Aspects of Semantic N etworks, J. Sowa, 
Ed., Morgan Kaufmann, Los Altos, CA, 1990, both of which 
are herein incorporated by reference in their entirety. 

20 CLASSIC is a description logic. As such, it 

permits users to create structured descriptions of sets 
of objects (known as concepts) and individual objects. 
As with any standard knowledge representation or object- 
oriented language, users may state hierarchical 

25 relationships between concepts. The main service 
provided by CLASSIC, however, is to determine 
subsumption relationships automatically by analyzing 
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concept descriptions. 

Determining subsumpt ion relationships is a key 
requirement for the invention. The invention uses 
CLASSIC to automatically maintain a rule hierarchy. For 
5 example, the conditions of the rule being edited in FIG. 
3 would be represented in CLASSIC as the following 
concept (referred to as C 0 ) : 

C 0 - me s s ageType = ema i 1 and 
10 sender = Julia-Hirschberg and 

sub j ect contains "important" 

Examples of concepts that subsume C 0 include 
concepts formed from a subset of its conjuncts, such as 

15 "messageType = email" (the more general rule shown in 
FIG. 3) or "sender = Julia-Hirschberg." The object 
hierarchy is use, so "messageType = Message" also 
subsumes C 0 . In addition, the semantics of substrings 
are used, so a concept like "subject contains "port 1 " 

2 0 also subsumes C 0 - 

CLASSIC also determines the intersection between 
two concepts . This is useful because users often state 
general rules that categorize messages by a single 
attribute, such as: 

25 

sender = Julia-Hirschberg 
subject contains "important." 
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CLASSIC determines whether these rules intersect. 
The intersection between these two rules is the 
conjunction of the two concepts. In general, however, 
CLASSIC may have to combine parts of two concepts to 
5 determine the intersection. For example, consider the 
two descriptions of message arrival times "between 12:00 
on November 8, 19 95 and 12:00 on November 10, 19 95" and 
"between 18:00 and 8:00." CLASSIC determines that the 
intersection is "18:00 to 23:59 on November 8, 1995, 

10 midnight to 8:00 and 18:00 to 23:59 on November 9, 1995, 
and midnight to 8:00 on November 10, 19 95." 

Like rule conditions, rule actions are represented 
as CLASSIC concepts. Actions are described in terms of 
a basic artificial intelligence (AI) planning model. 

15 Each action applies in a particular "state of the world," 
represented as a list of facts, and each action may 
change the state of the world. Thus, an action is 
defined in terms of its preconditions (facts which must 
be true for the action to be applied) , add list (facts 

20 added by the actions) , and delete list (facts deleted by 
the action) . For example, the action PickupCall is 
defined as: 

preconditions : TelephoneCall 
25 add : CallPickedup 

If an action A x occurs in a plan before an action A 2/ and 
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A 1 deletes a precondition of A 2 , then A 2 defeats A 2 . 

AI planning research explores planning synthesis 
(creating a plan that transforms a specified initial 
state to a specified final state) and recognition 
5 (inferring an agent ! s plan by observing his/her/its 

actions) , both of which are very difficult computational 
problems. By way of contrast, the invention allows the 
user to construct a plan, i.e. , the actions of a rule. 
Thus the agent manager need only check plan validity, 

10 which is a much less expensive (in terms of CPU cycles) 
computational task . 

Thus, as shown in FIG. 6, the agent manager inserts 
the new rule defined by the user into a rule hierarchy 
at step 302. One way to establish a rule hierarchy is 

15 to use CLASSIC. The plan from parent rule PARENT is 
inherited to the new plan NEW and added at the proper 
position in NEW 1 s plan at step 304. NEW ! s plan is 
inherited to its child CHILD and inserted in the proper 
position, i.e. , after the local plan of CHILD and before 

20 the more general plan of PARENT, at step 306. The 

intersection INTER of NEW and its sibling rule SIBLING 
is formed at step 308, and all the appropriate plans are 
inherited to INTER at step 310. It is worthy to note 
that the user only becomes aware of INTER if some action 

25 in its plan is defeated. All the composed plans are 
checked for validity by rule analysis module 400, and 
whenever any actions of rule's plan are defeated, the 
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display of the rule is updated to reflect this fact. 

FIG . 7 is a flow diagram of a rule analysis module 
used in accordance with one embodiment of the invention. 
The rule analysis module 400 of the agent manager 
5 detects when a rule's plan is not valid, i.e., some 

action does not apply. This can occur either as a user 
edits a rule or when the rule is added to the hierarchy. 
When the agent manager finds an invalid plan, it 
computes repairs, which are changes to the plan that 

10 will make the plan valid. It then presents an 

interactive explanation that explains the nature of the 
problem and guides the user in selecting a repair. 

The task of verifying plan validity centers around 
the notion of current state. The conditions of a rule 

15 define an initial state that is the class of messages to 
which the actions apply. Each action transforms the 
initial state by adding or deleting facts. For example, 
the initial state for the rule in FIG . 3 is: 



2 0 InSpool and 

messageType = email and 
sender = Julia-Hirshberg and 
sub j ect contains "important . " 



25 InSpool is a special tag indicating that the message has 

not yet been disposed of, i.e. , deleted or moved to a 

folder. All actions have at least one precondition - 

118692 



Murray 1-5 AA 

InSpool - which is the one fact in delete list of "Move 
Message." Thus, adding a "Move Message" action results 
in the removal of InSpool from the current state. If 
any other actions are subsequently added to the rule, 
5 the system will find that they do not apply. 

The system has to update the current state whenever 
an action is added, deleted or inserted, or when the 
conditions are changed, as described previously in 
reference to FIG. 5. When an action is added to the end 

10 of the plan, all that has to be checked is that action 1 s 
applicability. Changing the conditions redefines the 
initial state, so the validity of the whole plan must be 
rechecked. When an action is inserted into or deleted 
from the middle of the plan, the whole plan again is 

15 checked. Alternatively, the checking could begin from 
the insertion/deletion point by keeping a record of 
previous states . 

As a user edits a rule, the agent manager 
continuously recomputes its position in the rule 

20 hierarchy, thus determining the actions to inherit to 
the rule from more general rules. Either the locally 
defined or the inherited actions of a rule may be done 
first. If the user has not specified an order, the 
system will prefer the local-first ordering, but if this 

25 results in an invalid plan, it will try inherited- first . 
For example, in FIG. 3, if the local "Move Message" 
action were ordered before the inherited "Copy Message" 
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action, the plan would be invalid, so the invention 
selected the inherited-first ordering. 

When a rule is added to the hierarchy, the Agent 
Manager inherits its plan to all more specific rules. 
5 It also considers rules resulting from the intersection 
of the new rule and its sibling rules. These cases all 
result in new plans being composed, all of whose 
validity must be tested. Notice that users become aware 
of intersection rules only if their plans are invalid. 
10 After actions are inherited, the plan at each rule 

to which actions have been inherited must be checked for 
validity. These rules are (potentially) NEW, all 
descendants of NEW, and all INTER rules of NEW and its 
siblings . 

15 Thus, as shown in FIG. 7, rule analysis module 400 

compares NEW, CHILD and INTER conditions with conditions 
from existing rules OLD at step 402. If a NEW, CHILD or 
INTER condition and OLD condition are the same, or 
simultaneous, at step 4 04, the agent manager determines 

2 0 if the actions of NEW, CHILD or INTER and OLD conflict 

(as previously discussed) . If they do conflict, the NEW 
or INTER plan is invalid, and rule analysis module 400 
moves to the next plan at step 410. If all plans are 
analyzed, risk analysis module 400 returns. If not, 

25 rule analysis module 400 processes the next plan from 
NEW, CHILD or INTER. 

At step 404, if the conditions of NEW, CHILD or 
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INTER and OLD are not the same, the agent manager tests 
whether the conditions of NEW, CHILD or INTER and OLD 
intersect at step 414. If they do, the agent manager 
checks if the actions conflict at step 406. If the 
5 actions conflict, the NEW, CHILD or INTER plan is 

invalid at step 408, and rule analysis module 400 moves 
to the next plan. If at step 414 the conditions of NEW, 
CHILD or INTER and OLD do not intersect, the plan is 
considered valid at step 412. 

10 FIG . 8 is a flow diagram of a first portion of a 

rule repair module used in accordance with one 
embodiment of the invention. When the agent manager 
detects that a rule has an invalid plan at step 502, it 
attempts to categorize the rule as one of a pre-defined 

15 set of invalid rule types at step 506. For example, the 
intersection of a rule that files messages by sender 
( e.g. . "move messages from Tom to the folder Tom-Mail") 
and a rule that files messages by subject ( e.g. , "move 
messages with the subject "RDDI 1 to the folder RDDI - 

2 0 Project") constitutes a common type of problem. The 
benefit of categorizing problems is that multiple 
instances of a given category may occur as a user works, 
and the user may specify that all problems of a 
particular category should be repaired in the same way. 

25 When an action in a plan does not apply, the agent 

manager computes repairs at step 508, and generates an 
interactive dialogue that explains why the action does 
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not apply and suggests repairs to the plan that will 
enable the action at step 510. How the agent manager 
computes repairs for a rule at step 508, and creates the 
interactive dialogue at step 510, is described in more 
5 detail as follows. 

The dialogue contains a component for each 
unsatisfied precondition of the action. The text is 
created by composing templates associated with actions, 
preconditions and plan modification operators. If a 

10 precondition was deleted by a previous action in the 

plan, the system looks for alternative actions whose add 
list is a superset of the defeating action and whose 
delete list does not contain the unsatisfied 
precondition. Consider the rule formed from the 

15 intersection of: 

messageType = email and 
sender = Julia-Hirschberg 
==> Move Message "julia", and 

20 

messageType = email and 
subj ect contains "important" 
==> Move Message "important". 

25 The two "Move Message" actions conflict with each other, 
since each deletes "InSpool" from the current state, and 
"InSpool" is a precondition of all actions. Since "Copy 
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Messa ge" adds the same facts as "Move Message" (the 
message is filed), but does not delete "InSpool," 
substituting "Copy Message" for "Move Message" actions 
would result in a valid plan. The agent manager would 
5 prompt the user as follows: 

"Move Message" does not apply because of the 
effect of a previous "Move Message" action was 
to move the message out of the mail spool -- 
10 you can take care of this by replacing the 

previous "Move Message" action by "Copy 
Message" . 
Do It 

15 If no action in the plan defeated an unsatisfied 

precondition, the system looks for actions that satisfy 
the precondition and do not defeat any other actions in 
the plan. Consider the rule: 

2 0 messageType = Message 

==> Play Greeting "Greeting 1". 

"Play Greeting" applies only to telephone calls, and only 
after a call has been picked up. Since the action 
25 "PickupCall" results in the call being picked up, 

inserting it into the plan would repair the second 
problem. The following message would be given to the 
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user : 
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"Play Greeting" does not apply because 

1) the current message is not a Telephone Call 
5 you can take care of this by selecting the 

Message Type Telephone Call 
Do It 

2) the call has not yet been picked up - - you 
can take care of this by inserting the action 

10 "Pickup Call" before "Play Greeting" 

Do It 

The algorithm for computing repairs is thus: 

15 For each unsatisfied Action A 

For each unsatisfied precondition P 
If 3 B in plan before A, and B deletes P 
Then Repairs = {b* such that B 1 .add 2 B . add & 
P € B r . delete} 

20 Else Repairs = {B 1 such that P e B'.add & B' 

can apply before A & B 1 does 
not defeat any later actions} 

2 5 The agent manager visually indicates rules with 

invalid plans and problematic actions in each plan. A 
user may access the repair dialogue associated with an 
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action by clicking on the action. After the user 
selects a repair, the system applies the repair, checks 
the validity of the plan again to see whether the status 
of any other actions has changed, and updates the repair 
5 dialogue to show the new status of the plan. 

Returning to the operation of FIG. 8, the user 
selects a repair at step 512, and the agent manager 
applies the selected repair at step 514. The repaired 
plan is analyzed to ensure its validity at step 515, 

10 using rule analysis module 400 described previously. If 
the repaired plan is valid at step 518, the current 
state for the repaired plan is updated at step 520. If 
the repaired plan is not valid at step 518, the agent 
manager generates another repair. 

15 FIG. 9 is a flow diagram of a second portion of a 

rule repair module used in accordance with one 
embodiment of the invention. If the repaired plan is 
valid at step 518, the agent manager checks whether the 
rule was a member of a problem category at step 522, and 

2 0 whether other rules also belong to the same category at 
step 524. In such cases, the agent manager asks whether 
the user wants to propagate the same repairs to all 
other rules in the category at step 526, and if so, 
applies the repairs to all plans within the same problem 

25 category at step 528. Once all the repaired plans are 
checked at step 53 0, the agent manager checks if all 
plans are checked at step 504 (shown in FIG. 8) , and if 
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so, returns. If not, the agent manager repairs the next 
plan. If all repaired plans are not checked at step 
53 0, the agent manager processes the next repaired plan. 
It can be appreciated by one skilled in the art 
5 that any software programs, schemes, steps or algorithms 
described herein with reference to an embodiment of the 
invention can be implemented in either hardware or 
software. If implemented in software, these software 
programs, schemes, steps or algorithms can be 

10 implemented on any general purpose computer, such as a 
personal computer, or special purpose computer, such as 
a digital signal processor (DSP) , having at a minimum a 
processor with sufficient processing speed, and a 
computer readable medium such as read-only memory (ROM) , 

15 programmable ROM (PROM) , erasable programmable ROM 

(EPROM) , random access memory (RAM) , hard drive, optical 
drive, floppy disk, and so forth. 

Conclusion 

20 

Although a preferred embodiment is specifically 
illustrated and described herein, it will be appreciated 
that modifications and variations of the present 
invention are covered by the above teachings and within 
25 the purview of the appended claims without departing 
from the spirit and intended scope of the invention. 
For example, although the rule hierarchy is defined 
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using CLASSIC, it can be appreciated that any mechanism 
for creating structured descriptions of sets of objects 
and individual objects falls within the scope of the 
invention. Another example is the rule editor used by 
5 rule edit module 200, and shown in FIG . 3. It can be 
appreciated that any editor allowing the definition of 
conditions, attributes and actions, or combinations 
thereof, falls within the scope of the invention. 
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11. A method for a user to program a personal software 

2 agent using an agent manager, wherein said agent manager 

3 is connected to an input device for receiving 

4 instructions from the user, comprising the steps of: 

5 creating a rule; 

6 placing said rule in an hierarchical order; 

7 determining whether said rule is valid within said 

8 hierarchical order; 

9 suggesting repairs to said rule if said rule is 
10 invalid. 

1 2. The method described in claim 1, wherein the user 

2 creates said rule by defining conditions, attributes and 

3 actions of said rule. 

1 3. The method described in claim 2, wherein said 

2 hierarchical order is comprised of parent rules, child 

3 rules, sibling rules, and inter rules. 

1 4. The method described in claim 3, wherein said rule 

2 is placed in said hierarchical order using CLASSIC. 

1 5. The method described in claim 4, wherein said rule 

2 inherits actions from said parent rules, wherein said 

3 child rules inherits actions from said rule, and said 
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1 inter rules inherits actions from the intersection of 

2 said rule and said sibling rules. 

1 6. The method described in claim 5, wherein CLASSIC 

2 determines subsumption relations among rules . 

1 7. The method described in claim 6, wherein CLASSIC 

2 determines intersections among rules. 
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1 8 e The method descrxbed in claim 7, wherein said 

2 action is defined in terms of preconditions, add list 

3 and delete list for said action. 

1 9. The method described in claim 8, wherein said rule 

2 is repaired using an interactive dialogue explaining why 

3 said action does not apply and suggesting repairs to 

4 said rule that will enable said actions. 

1 10. The method described in claim 9, wherein said 

2 invalid rule is categorized according to why said rule 

3 is invalid. 

1 11. The method described in claim 10, wherein repairs 

2 applied to said invalid rule are applied to rules in the 

3 same category as said invalid rule. 

1 12. An agent manager for a personal software agent, the 

2 agent manager having an input device for receiving 

3 instructions from a user, comprising: 

4 rule edit module having a rule edit input coupled 

5 to the input device for receiving instructions from the 

6 user for creating a rule, and having a rule edit output; 

7 rule index module having a rule index input coupled 

8 to said rule edit output for receiving said rule and 

9 placing said rule in hierarchical order, and having a 
10 rule index output ; 
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1 rule analysis module having a rule analysis input 

2 coupled to said rule index output for receiving said 

3 hierarchical order and using said hierarchical order for 

4 determining whether said rule is valid, and having a 

5 rule analysis output; and 

6 rule repair module having a rule repair input 

7 coupled to said rule analysis output to receive said 

8 rule if said rule is invalid in order to guide the user 

9 in selecting and applying repairs to make the rule 
10 valid. 

1 13. The agent manager described in claim 12, wherein 

2 said rule edit module allows the user to enter 

3 conditions, attributes and actions to define said rule. 

1 14. The agent manager described in claim 13, wherein 

2 said hierarchical order is comprised of parent rules, 

3 child rules, sibling rules, and inter rules. 

1 15. The agent manager described in claim 14, wherein 

2 said rule index module permits the user to create 

3 structured descriptions of sets of objects and 

4 individual obj ects . 

1 16. The agent manager described in claim 15, wherein 

2 said rule index module represents said rule using 

3 CLASSIC. 
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1 17. The agent manager described in claim 16, wherein 

2 said rule index module inherits actions from said parent 

3 rules to said rule, inherits actions from said rule to 

4 said child rules, and inherits actions from the 

5 intersection of said rule and said sibling rules to said 

6 inter rules. 

1 18. The agent manager described in claim 17, wherein 

2 said rule index module determines subsumption relations 

3 among rules. 

1 19. The agent manager described in claim 18, wherein 

2 said rule index module determines intersections among 

3 rules. 

1 20. The agent manager described in claim 19, wherein 

2 said action is defined in terms of preconditions, add 

3 list and delete list for said action. 

1 21. The agent manager described in claim 20, wherein 

2 said rule repair module creates an interactive dialogue 

3 explaining why said action does not apply and suggests 

4 repairs to said rule that will enable said actions. 

1 22. The agent manager described in claim 21, wherein 

2 said rule repair module categorizes invalid plans 
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1 according to why said plans are invalid. 

1 23. The agent manager described in claim 22, wherein 

2 said rule repair module applies said repairs to rules in 

3 the same category as said invalid rule. 

1 24. Apparatus for automatically verifying whether a new 

2 rule which is to be added to a set of rules is valid 

3 with respect to the set of rules, each rule specifying a 

4 set of conditions and a sequence of actions being 

5 interpreted in a system which causes the actions 

6 specified in the rule to be performed when the 

7 conditions specified in the rule are satisfied, the 

8 apparatus comprising : 

9 a stored subsumption hierarchy of the rules in the 

10 set of rules; 

11 means for placing the new rule in the subsumption 

12 hierarchy ; and 

13 means for using the subsumption hierarchy which 

14 includes the new rule to determine whether the rule is 

15 valid and provide an indication of invalidity when the 

16 rule is not valid. 

1 25 . The apparatus described in claim 24 , wherein the 

2 means for using the subsumption hierarchy further uses 

3 the subsumption hierarchy to determine a suggested 

4 correction for the new rule when the new rule is not 
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5 valid and provide the suggested correction, 

1 26. The apparatus described in claim 25, further 

2 comprising means responsive to an input from a user of 

3 the apparatus indicating acceptance of the suggested 

4 correction for correcting the new rule according to the 

5 suggested correction. 

1 27, The apparatus described in claim 26, wherein the 

2 means for using the subsumption hierarchy determines 

3 whether the rule is valid by using the subsumption 

4 hierarchy to determine whether the conditions of the new 

5 rule and another rule of the set of rules can apply 

6 simultaneously and if the conditions do so apply, 

7 analyzing the actions of the rules for conflicts. 
8 

9 28. The apparatus described in claim 27, wherein the 

10 means for using the subsumption hierarchy determines 

11 whether the conditions of the new rule and another rule 

12 can apply simultaneously by using the subsumption 

13 hierarchy to determine whether the condition of one of 

14 the rules is more general than the condition of the 

15 other or whether the condition of one of the rules 

16 intersects with the condition of the other of the rules. 

1 29. The apparatus described in claim 28, wherein the 

2 means for using the subsumption hierarchy further uses 
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1 the subsurnption hierarchy to determine a category for a 

2 suggested correction which has been accepted and find 

3 other rules which require corrections belonging to the 

4 category. 

1 30. The apparatus described in claim 29, wherein the 

2 means for placing the new rule in the subsurnption 

3 hierarchy does so each time the new rule is altered. 



1 31. Interactive rule editing apparatus for editing a 

2 rule which is to be added to a set thereof, each rule 

3 specifying a condition and an action and being 

4 interpreted in a system which causes the action 

5 specified in the rule to be performed when the condition 

6 specified in the rule is satisfied, the interactive rule 

7 editing apparatus comprising : 

8 input means ; 

9 output means; 

10 means for determining whether the rule to be added 

11 is valid with regard to the set thereof and if the rule 

12 to be added is not valid, providing a suggested 

13 correction ; 

14 means for altering the rule; and wherein 

15 the input means receives the rule to be added 

16 and provides the rule to be added to the means for 

17 determining ; 

18 the output means receives the suggested 
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19 correction and outputs the suggested correction; 

2 0 the input means receives an indication that 

21 the suggested correction has been accepted; and 

22 the means for altering the rule responds to 

23 the indication by altering the rule to be added in 

24 accordance with the suggested correction. 
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ABSTRACT OF DISCLOSURE : 



1 An apparatus and method for a user to program a 

2 personal software agent using an agent manager. The 

3 agent manager receives instructions for creating a rule. 

4 The rule is placed in a hierarchical order. A 

5 determination is made as to whether the rule is valid 

6 within the hierarchical order. If the rule is not 

7 valid, repairs are suggested to make the rule valid. 
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IN THE UNTIED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 
name. 

I believe I am an original, first and joint inventor of the subject matter which is 
claimed and for which a patent is sought on the invention entitled Apparatus And 
Methods For Defining Rules For Personal Agents the specification of which was filed 
on April 9, 1996, as application Serial No. 08/769694. 

I hereby state that I have reviewed and understand the contents of the above 
O identified specification, including the claims, as amended by an amendment, if any, 

S! specifically referred to in this oath or declaration. 

rp I acknowledge the duty to disclose all information known to me which is material to 

\Q % patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

Ill I hereby claim foreign priority benefits under Title 35, United States Code, 119 of 

*p any foreign application(s) for patent or inventor's certificate listed below and have also 

7* identified below any foreign application for patent or inventor's certificate having a filing 

^ date before that of the application on which priority is claimed: 

; *; None 

!*f I hereby claim the benefit under Title 35, United States Code, 120 of any United 

States application(s) listed below and, insofar as the subject matter of each of the claims 

y 1 of this application is not disclosed in the prior United States application in the manner 

provided by the first paragraph of Title 35, United States Code, 1 12, 1 acknowledge the 
duty to disclose all information known to me to be material to patentability as defined in 
Title 37, Code of Federal Regulations, 1.56 which became available between the filing 
date of the prior application and the national or PCT international filing date of this 
application: 



None 



I hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 
of the United States Code and that such willM false statements may jeopardize the 
validity of the application or any patent issued thereon. 
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I hereby appoint the following attorney(s) with full power of substitution and 
revocation, to prosecute said application, to make alterations and amendments therein, to 
receive the patent, and to transact all business in the Patent and Trademark Office 
connected therewith: 

Samuel H. Dworetsky (Reg. No. 27873) 

Henry T. Brendzel (Reg. No. 26844) 

Please address all correspondence to Mr. S. H. Dworetsky, AT&T Corp., 
P.O. Box 4110, Middletown, New Jersey 07748. Telephone calls should be made to 
Samuel H. Dworetsky by dialing 908-204-8701. 



Full name of 1st joint inventor: LaTondra Alyce Murray 
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Inventor's signature d^Zj^ Ti rte ^ha-jfJ 

Residence: Raleigh, County, North Carolina 

Citizenship: United States of America 

Post Office Address: 3271-0 Calumet Drive 

Raleigh, North Carolina 27610 



Full name of 2nd joint inventor: Loren Gilbert Terveen 

Inventor's signature ^f! Z^u <X j^ v — D ate 

Residence: Basking Ridge, Somerset County, New Jersey 

Citizenship: United States of America 

Post Office Address: 175 Locust Lane 
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